Audio-coupled video content understanding of unconstrained video sequences

Unconstrained video understanding is a difficult task. The main aim of this thesis is to recognise the nature of objects, activities and environment in a given video clip using both audio and video information. Traditionally, audio and video information has not been applied together for solving such complex task, and for the first time we propose, develop, implement and test a new framework of multi-modal (audio and video) data analysis for context understanding and labelling of unconstrained videos. The framework relies on feature selection techniques and introduces a novel algorithm (PCFS) that is faster than the well-established SFFS algorithm. We use the framework for studying the benefits of combining audio and video information in a number of different problems. We begin by developing two independent content recognition modules. The first one is based on image sequence analysis alone, and uses a range of colour, shape, texture and statistical features from image regions with a trained classifier to recognise the identity of objects, activities and environment present. The second module uses audio information only, and recognises activities and environment. Both of these approaches are preceded by detailed pre-processing to ensure that correct video segments containing both audio and video content are present, and that the developed system can be made robust to changes in camera movement, illumination, random object behaviour etc. For both audio and video analysis, we use a hierarchical approach of multi-stage classification such that difficult classification tasks can be decomposed into simpler and smaller tasks. When combining both modalities, we compare fusion techniques at different levels of integration and propose a novel algorithm that combines advantages of both feature and decision-level fusion. The analysis is evaluated on a large amount of test data comprising unconstrained videos collected for this work. We finally, propose a decision correction algorithm which shows that further steps towards combining multi-modal classification information effectively with semantic knowledge generates the best possible results.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Strain-induced Evolution of Electronic Band Structures in a Twisted Graphene Bilayer

Here we study the evolution of local electronic properties of a twisted graphene bilayer induced by a strain and a high curvature. The strain and curvature strongly affect the local band structures of the twisted graphene bilayer; the energy difference of the two low-energy van Hove singularities decreases with increasing the lattice deformations and the states condensed into well-defined pseudo-Landau levels, which mimic the quantization of massive Dirac fermions in a magnetic field of about 100 T, along a graphene wrinkle. The joint effect of strain and out-of-plane distortion in the graphene wrinkle also results in a valley polarization with a significant gap, i.e., the eight-fold degenerate Landau level at the charge neutrality point is splitted into two four-fold degenerate quartets polarized on each layer. These results suggest that strained graphene bilayer could be an ideal platform to realize the high-temperature zero-field quantum valley Hall effect.Comment: 4 figure

Effectiveness and long-term retention of anti-tumour necrosis factor treatment in juvenile and adult patients with juvenile idiopathic arthritis: data from Reuma.pt

Methods. We prospectively collected patient and disease characteristics from patients with JIA who started biological therapy. Adverse events were collected during the follow-up period. Predictors of response at 1 year and drug retention rates were assessed at 4 years of treatment for the first biologic agent.Results. A total of 812 JIA patients [65% females, mean age at JIA onset 6.9 years (s.d. 4.7)], 227 received biologic therapy; 205 patients (90.3%) were treated with an anti-TNF as the first biologic. All the parameters used to evaluate disease activity, namely number of active joints, ESR and Childhood HAQ/HAQ, decreased significantly at 6 months and 1 year of treatment. The mean reduction in Juvenile Disease Activity Score 10 (JADAS10) after 1 year of treatment was 10.4 (s.d. 7.4). According to the definition of improvement using the JADAS10 score, 83.3% respond to biologic therapy after 1 year. Fourteen patients discontinued biologic therapies due to adverse events. Retention rates were 92.9% at 1 year, 85.5% at 2 years, 78.4% at 3 years and 68.1% at 4 years of treatment. Among all JIA subtypes, only concomitant therapy with corticosteroids was found to be univariately associated with withdrawal of biologic treatment (P = 0.016).Conclusion. Biologic therapies seem effective and safe in patients with JIA. In addition, the retention rates for the first biologic agent are high throughout 4 years

Goal-directed fluid management based on pulse pressure variation monitoring during high-risk surgery: a pilot randomized controlled trial

Abstract\ud \ud \ud \ud Introduction\ud \ud Several studies have shown that maximizing stroke volume (or increasing it until a plateau is reached) by volume loading during high-risk surgery may improve post-operative outcome. This goal could be achieved simply by minimizing the variation in arterial pulse pressure (ΔPP) induced by mechanical ventilation. We tested this hypothesis in a prospective, randomized, single-centre study. The primary endpoint was the length of postoperative stay in hospital.\ud \ud \ud \ud Methods\ud \ud Thirty-three patients undergoing high-risk surgery were randomized either to a control group (group C, n = 16) or to an intervention group (group I, n = 17). In group I, ΔPP was continuously monitored during surgery by a multiparameter bedside monitor and minimized to 10% or less by volume loading.\ud \ud \ud \ud Results\ud \ud Both groups were comparable in terms of demographic data, American Society of Anesthesiology score, type, and duration of surgery. During surgery, group I received more fluid than group C (4,618 ± 1,557 versus 1,694 ± 705 ml (mean ± SD), P < 0.0001), and ΔPP decreased from 22 ± 75 to 9 ± 1% (P < 0.05) in group I. The median duration of postoperative stay in hospital (7 versus 17 days, P < 0.01) was lower in group I than in group C. The number of postoperative complications per patient (1.4 ± 2.1 versus 3.9 ± 2.8, P < 0.05), as well as the median duration of mechanical ventilation (1 versus 5 days, P < 0.05) and stay in the intensive care unit (3 versus 9 days, P < 0.01) was also lower in group I.\ud \ud \ud \ud Conclusion\ud \ud Monitoring and minimizing ΔPP by volume loading during high-risk surgery improves postoperative outcome and decreases the length of stay in hospital.\ud \ud \ud \ud Trial registration\ud \ud NCT00479011The authors thank Maria De Amorim (Paris, France) and Julia Fukushima (São Paulo, SP, Brazil) for help in data analysis, Dr Julia Wendon (London, UK) for reviewing the manuscript, and Dixtal (Sao Paulo, SP, Brazil) for providing the software for the automatic calculation of ?PP.The authors thank Maria De Amorim (Paris, France) and Julia Fukushima (São Paulo, SP, Brazil) for help in data analysis, Dr Julia Wendon (London, UK) for reviewing the manuscript, and Dixtal (Sao Paulo, SP, Brazil) for providing the software for the automatic calculation of ?PP

Environmental factors modulating the stability and enzymatic activity of the Petrotoga mobilis Esterase (PmEst)

Enzymes isolated from thermophilic organisms found in oil reservoirs can find applications in many fields, including the oleochemical, pharmaceutical, bioenergy, and food/dairy industries. In this study, in silico identification and recombinant production of an esterase from the extremophile bacteria Petrotoga mobilis (designated PmEst) were performed. Then biochemical, bioinformatics and structural characterizations were undertaken using a combination of synchrotron radiation circular dichroism (SRCD) and fluorescence spectroscopies to correlate PmEst stability and hydrolytic activity on different substrates. The enzyme presented a high Michaelis-Menten constant (KM 0.16 mM) and optimum activity at ~55°C for p-nitrophenyl butyrate. The secondary structure of PmEst was preserved at acid pH, but not under alkaline conditions. PmEst was unfolded at high concentrations of urea or guanidine through apparently different mechanisms. The esterase activity of PmEst was preserved in the presence of ethanol or propanol and its melting temperature increased ~8°C in the presence of these organic solvents. PmEst is a mesophilic esterase with substrate preference towards short-to medium-length acyl chains. The SRCD data of PmEst is in agreement with the prediction of an α/β protein, which leads us to assume that it displays a typical fold of esterases from this family. The increased enzyme stability in organic solvents may enable novel applications for its use in synthetic biology. Taken together, our results demonstrate features of the PmEst enzyme that indicate it may be suitable for applications in industrial processes, particularly, when the use of polar organic solvents is required

Energy Estimation of Cosmic Rays with the Engineering Radio Array of the Pierre Auger Observatory

The Auger Engineering Radio Array (AERA) is part of the Pierre Auger Observatory and is used to detect the radio emission of cosmic-ray air showers. These observations are compared to the data of the surface detector stations of the Observatory, which provide well-calibrated information on the cosmic-ray energies and arrival directions. The response of the radio stations in the 30 to 80 MHz regime has been thoroughly calibrated to enable the reconstruction of the incoming electric field. For the latter, the energy deposit per area is determined from the radio pulses at each observer position and is interpolated using a two-dimensional function that takes into account signal asymmetries due to interference between the geomagnetic and charge-excess emission components. The spatial integral over the signal distribution gives a direct measurement of the energy transferred from the primary cosmic ray into radio emission in the AERA frequency range. We measure 15.8 MeV of radiation energy for a 1 EeV air shower arriving perpendicularly to the geomagnetic field. This radiation energy -- corrected for geometrical effects -- is used as a cosmic-ray energy estimator. Performing an absolute energy calibration against the surface-detector information, we observe that this radio-energy estimator scales quadratically with the cosmic-ray energy as expected for coherent emission. We find an energy resolution of the radio reconstruction of 22% for the data set and 17% for a high-quality subset containing only events with at least five radio stations with signal.Comment: Replaced with published version. Added journal reference and DO

Measurement of the cosmic ray spectrum above 4×10184{\times}10^{18} eV using inclined events detected with the Pierre Auger Observatory

A measurement of the cosmic-ray spectrum for energies exceeding $4{\times}10^{18}$ eV is presented, which is based on the analysis of showers with zenith angles greater than $60^{\circ}$ detected with the Pierre Auger Observatory between 1 January 2004 and 31 December 2013. The measured spectrum confirms a flux suppression at the highest energies. Above $5.3{\times}10^{18}$ eV, the "ankle", the flux can be described by a power law $E^{-\gamma}$ with index $\gamma=2.70 \pm 0.02 \,\text{(stat)} \pm 0.1\,\text{(sys)}$ followed by a smooth suppression region. For the energy ($E_\text{s}$) at which the spectral flux has fallen to one-half of its extrapolated value in the absence of suppression, we find $E_\text{s}=(5.12\pm0.25\,\text{(stat)}^{+1.0}_{-1.2}\,\text{(sys)}){\times}10^{19}$ eV.Comment: Replaced with published version. Added journal reference and DO